Habit formation viewed as structural change in the behavioral network.

Habit formation is a process in which an action becomes involuntary. While goal-directed behavior is driven by its consequences, habits are elicited by a situation rather than its consequences. Existing theories have proposed that actions are controlled by corresponding two distinct systems. Although canonical theories based on such distinctions are starting to be challenged, there are a few theoretical frameworks that implement goal-directed behavior and habits within a single system. Here, we propose a novel theoretical framework by hypothesizing that behavior is a network composed of several responses. With this framework, we have shown that the transition of goal-directed actions to habits is caused by a change in a single network structure. Furthermore, we confirmed that the proposed network model behaves in a manner consistent with the existing experimental results reported in animal behavioral studies. Our results revealed that habit could be formed under the control of a single system rather than two distinct systems. By capturing the behavior as a single network change, this framework provides a new perspective on studying the structure of the behavior for experimental and theoretical research.

Pupillary dynamics of mice performing a Pavlovian delay conditioning task reflect reward-predictive signals.

Pupils can signify various internal processes and states, such as attention, arousal, and working memory. Changes in pupil size have been associated with learning speed, prediction of future events, and deviations from the prediction in human studies. However, the detailed relationships between pupil size changes and prediction are unclear. We explored pupil size dynamics in mice performing a Pavlovian delay conditioning task. A head-fixed experimental setup combined with deep-learning-based image analysis enabled us to reduce spontaneous locomotor activity and to track the precise dynamics of pupil size of behaving mice. By setting up two experimental groups, one for which mice were able to predict reward in the Pavlovian delay conditioning task and the other for which mice were not, we demonstrated that the pupil size of mice is modulated by reward prediction and consumption, as well as body movements, but not by unpredicted reward delivery. Furthermore, we clarified that pupil size is still modulated by reward prediction even after the disruption of body movements by intraperitoneal injection of haloperidol, a dopamine D2 receptor antagonist. These results suggest that changes in pupil size reflect reward prediction signals. Thus, we provide important evidence to reconsider the neuronal circuit involved in computing reward prediction error. This integrative approach of behavioral analysis, image analysis, pupillometry, and pharmacological manipulation will pave the way for understanding the psychological and neurobiological mechanisms of reward prediction and the prediction errors essential to learning and behavior.

Median raphe serotonergic neurons projecting to the interpeduncular nucleus control preference and aversion.

Appropriate processing of reward and aversive information is essential for survival. Although a critical role of serotonergic neurons in the dorsal raphe nucleus (DRN) in reward processing has been shown, the lack of rewarding effects with selective serotonin reuptake inhibitors (SSRIs) implies the presence of a discrete serotonergic system playing an opposite role to the DRN in the processing of reward and aversive stimuli. Here, we demonstrated that serotonergic neurons in the median raphe nucleus (MRN) of mice process reward and aversive information in opposite directions to DRN serotonergic neurons. We further identified MRN serotonergic neurons, including those projecting to the interpeduncular nucleus (5-HTMRN→IPN), as a key mediator of reward and aversive stimuli. Moreover, 5-HT receptors, including 5-HT2A receptors in the interpeduncular nucleus, are involved in the aversive properties of MRN serotonergic neural activity. Our findings revealed an essential function of MRN serotonergic neurons, including 5-HTMRN→IPN, in the processing of reward and aversive stimuli.

Spatiotemporal Pavlovian head-fixed reversal learning task for mice.

Our world is full of uncertainty. Animals, including humans, need to behave flexibly to adjust to ever-changing environments. Reversal learning tasks have been used to assess behavioral flexibility in many species. However, there are some limitations in the traditional free-moving methodology, including (1) sessions to train the animals, (2) within-session number of trials associated with reversals, (3) factors of physical movement unrelated to the task in the maze or operant box, and (4) incompatibility with techniques, such as two-photon imaging. Therefore, to address these limitations, we established a novel spatiotemporal Pavlovian head-fixed reversal learning task for mice. Six experimentally naive adult C57BL/6J mice were used in this study. First, we trained head-fixed mice on a fixed-time schedule task. Sucrose solution was delivered every 10 s with a single drinking spout placed within the licking distance of the mice. After the mice showed anticipatory licking toward the timing of sucrose solution delivery, we began training the mice on the fixed-time schedule reversal learning task with two licking spouts. In this task, sucrose solution was delivered through one of the two drinking spouts. The rewarding spout was switched every 10 trials. Mice quickly learned to switch anticipatory licking to the rewarding side of the spouts, suggesting that they learned this head-fixed reversal learning task. Using the head-fixed experimental design, behavioral measures can be simplified by eliminating the complex behavioral sequences observed in free-moving animals. This novel head-fixed reversal learning task is a useful assay for studying the neurobiological mechanism of behavioral flexibility that is impaired in various psychopathological conditions.

Systemic injection of nicotinic acetylcholine receptor antagonist mecamylamine affects licking, eyelid size, and locomotor and autonomic activities but not temporal prediction in male mice.

Nicotinic acetylcholine receptors are thought to be associated with a wide range of phenomena, such as movement, learning, memory, attention, and addiction. However, the causal relationship between nicotinic receptor activity and behavior remains unclear. Contrary to the studies that examined the functions of muscarinic acetylcholine receptors, the role of the nicotinic acetylcholine receptors on behavior has not been examined as extensively. Here, we examined the effects of intraperitoneal injection of mecamylamine, a nicotinic acetylcholine receptor antagonist, on the performance of male mice in a head-fixed temporal conditioning task and a free-moving open-field task. The head-fixed experimental setup allowed us to record and precisely quantify the licking response while the mice performed the behavioral task with no external cues. In addition, by combining the utility of the head-fixed experimental design with computer vision analysis based on deep learning algorithms, we succeeded in quantifying the eyelid size of awake mice. In the temporal conditioning task, we delivered a 10% sucrose solution every 10 s using a blunt-tipped needle placed within the licking distance of the mice. After the training, the mice showed increased anticipatory licking toward the timing of sucrose delivery, suggesting that the mice could predict the timing of the reward. Systemic injection of mecamylamine decreased licking behavior and caused eye closure but had no effect on learned conditioned predictive behavior in the head-fixed temporal conditioning task. In addition, the injection of mecamylamine decreased spontaneous locomotor activity in a dose-dependent manner in the free-moving open-field task. The results in the open-field experiments further revealed that the effect of mecamylamine on fecal output and urination, suggesting the effects on autonomic activities. Our achievement of successful eyelid size recording has potential as a useful approach in initial screening for drug discovery. Our study paves a way forward to understanding the role of nicotinic acetylcholine receptors on learning and behavior.

Dysregulation of the Synaptic Cytoskeleton in the PFC Drives Neural Circuit Pathology, Leading to Social Dysfunction.

Psychiatric disorders are highly heritable pathologies of altered neural circuit functioning. How genetic mutations lead to specific neural circuit abnormalities underlying behavioral disruptions, however, remains unclear. Using circuit-selective transgenic tools and a mouse model of maladaptive social behavior (ArpC3 mutant), we identify a neural circuit mechanism driving dysfunctional social behavior. We demonstrate that circuit-selective knockout (ctKO) of the ArpC3 gene within prefrontal cortical neurons that project to the basolateral amygdala elevates the excitability of the circuit neurons, leading to disruption of socially evoked neural activity and resulting in abnormal social behavior. Optogenetic activation of this circuit in wild-type mice recapitulates the social dysfunction observed in ArpC3 mutant mice. Finally, the maladaptive sociability of ctKO mice is rescued by optogenetically silencing neurons within this circuit. These results highlight a mechanism of how a gene-to-neural circuit interaction drives altered social behavior, a common phenotype of several psychiatric disorders.

Publisher Correction: A craniofacial-specific monosynaptic circuit enables heightened affective pain.

In the version of this article initially published, ORCID links were missing for authors Erica Rodriguez, Koji Toda and Fan Wang. The error has been corrected in the HTML and PDF versions of the article.

Nigrotectal Stimulation Stops Interval Timing in Mice.

Considerable evidence implicates the basal ganglia in interval timing, yet the underlying mechanisms remain poorly understood. Using a novel behavioral task, we demonstrate that head-fixed mice can be trained to show the key features of timing behavior within a few sessions. Single-trial analysis of licking behavior reveals stepping dynamics with variable onset times, which is responsible for the canonical Gaussian distribution of timing behavior. Moreover, the duration of licking bouts decreased as mice became sated, showing a strong motivational modulation of licking bout initiation and termination. Using optogenetics, we examined the role of the basal ganglia output in interval timing. We stimulated a pathway important for licking behavior, the GABAergic output projections from the substantia nigra pars reticulata to the deep layers of the superior colliculus. We found that stimulation of this pathway not only cancelled licking but also delayed the initiation of anticipatory licking for the next interval in a frequency-dependent manner. By combining quantitative behavioral analysis with optogenetics in the head-fixed setup, we established a new approach for studying the neural basis of interval timing.

A craniofacial-specific monosynaptic circuit enables heightened affective pain.

Humans often rank craniofacial pain as more severe than body pain. Evidence suggests that a stimulus of the same intensity induces stronger pain in the face than in the body. However, the underlying neural circuitry for the differential processing of facial versus bodily pain remains unknown. Interestingly, the lateral parabrachial nucleus (PBL), a critical node in the affective pain circuit, is activated more strongly by noxious stimulation of the face than of the hindpaw. Using a novel activity-dependent technology called CANE developed in our laboratory, we identified and selectively labeled noxious-stimulus-activated PBL neurons and performed comprehensive anatomical input-output mapping. Surprisingly, we uncovered a hitherto uncharacterized monosynaptic connection between cranial sensory neurons and the PBL-nociceptive neurons. Optogenetic activation of this monosynaptic craniofacial-to-PBL projection induced robust escape and avoidance behaviors and stress calls, whereas optogenetic silencing specifically reduced facial nociception. The monosynaptic circuit revealed here provides a neural substrate for heightened craniofacial affective pain.

[Validation of a Japanese version of the Experience in Close Relationship- Relationship Structure].

The purpose of this study was to translate the Experience of Close Relationship-Relationship Structure (ECRRS) and evaluate its validity. In study 1 (N = 982), evidence based internal structure (factor structure, internal consistency, and correlation among sub-scales) and evidence based relations to other variables (depression, reassurance seeking and self-esteem) were confirmed. In study 2 (N = 563), evidence based on internal structure was reconfirmed, and evidence based relations to other variables (IWMS, RQ, and ECR-GO) were confirmed. In study 3 (N = 342), evidence based internal structure (test-retest reliability) was confirmed. Based on these results, we concluded that ECR-RS was valid for measuring adult attachment style.

Neural mechanisms of social decision-making in the primate amygdala.

Social decisions require evaluation of costs and benefits to oneself and others. Long associated with emotion and vigilance, the amygdala has recently been implicated in both decision-making and social behavior. The amygdala signals reward and punishment, as well as facial expressions and the gaze of others. Amygdala damage impairs social interactions, and the social neuropeptide oxytocin (OT) influences human social decisions, in part, by altering amygdala function. Here we show in monkeys playing a modified dictator game, in which one individual can donate or withhold rewards from another, that basolateral amygdala (BLA) neurons signaled social preferences both across trials and across days. BLA neurons mirrored the value of rewards delivered to self and others when monkeys were free to choose but not when the computer made choices for them. We also found that focal infusion of OT unilaterally into BLA weakly but significantly increased both the frequency of prosocial decisions and attention to recipients for context-specific prosocial decisions, endorsing the hypothesis that OT regulates social behavior, in part, via amygdala neuromodulation. Our findings demonstrate both neurophysiological and neuroendocrinological connections between primate amygdala and social decisions.

Non-invasive primate head restraint using thermoplastic masks.

BACKGROUND: The success of many neuroscientific studies depends upon adequate head fixation of awake, behaving animals. Typically, this is achieved by surgically affixing a head-restraint prosthesis to the skull. NEW METHOD: Here we report the use of thermoplastic masks to non-invasively restrain monkeys' heads. Mesh thermoplastic sheets become pliable when heated and can then be molded to an individual monkey's head. After cooling, the custom mask retains this shape indefinitely for day-to-day use. RESULTS: We successfully trained rhesus macaques (Macaca mulatta) to perform cognitive tasks while wearing thermoplastic masks. Using these masks, we achieved a level of head stability sufficient for high-resolution eye-tracking and intracranial electrophysiology. COMPARISON WITH EXISTING METHOD: Compared with traditional head-posts, we find that thermoplastic masks perform at least as well during infrared eye-tracking and single-neuron recordings, allow for clearer magnetic resonance image acquisition, enable freer placement of a transcranial magnetic stimulation coil, and impose lower financial and time costs on the lab. CONCLUSIONS: We conclude that thermoplastic masks are a viable non-invasive form of primate head restraint that enable a wide range of neuroscientific experiments.

Animal cognition: monkeys pass the mirror test.

A new study finds that rhesus monkeys display self-recognition behaviors toward a mirror after multimodal sensory-motor training. This finding closes a prior gap in the evolutionary continuity of animal cognition and opens new frontiers for exploring the neurobiological basis of self-awareness.

Measuring the actual timing of liquid-reward delivery using a thermistor.

BACKGROUND: Determining the exact timing of reward delivery is critical in neurophysiological experiments. Despite the importance of this parameter, techniques for precisely measuring the exact delivery time of a liquid reward have been underdeveloped. Although there is always some latency between the computer command and reward delivery, the former has been used routinely to mark reward onset time. NEW METHOD: To address this issue, we developed two methods of estimating the time of liquid reward delivery. First, electrical conduction between two contacts at the outlet of a pipe was detected. This technique was impractical during normal experiments but was a direct and reliable method of measuring the precise timing of water outflow. Second, a self-heating thermistor inside the fluid delivery pipe was used. The thermistor detected a decrease in temperature upon commencement of water flow. RESULTS: The electrical contact began 50-80ms after the computer command. The thermistor-based delivery timing estimation was ∼40ms later than that measured by the electrical contact. The time lag was constant with minimal variance between trials within the same experimental setup. COMPARISON WITH EXISTING METHOD: As far as the time difference between the two methods is measured, the timing of water outflow can be estimated using the thermistor-based device. This is the first method of estimating the onset time of water flow during experiments. CONCLUSIONS: Our new system could be used to quantify setup-dependent changes in the timing of reward delivery, improving the sophistication of reward assessments in neurophysiological experiments.

Neurons in monkey dorsal raphe nucleus code beginning and progress of step-by-step schedule, reward expectation, and amount of reward outcome in the reward schedule task.

The dorsal raphe nucleus is the major source of serotonin in the brain. It is connected to brain regions related to reward processing, and the neurons show activity related to predicted reward outcome. Clinical observations also suggest that it is important in maintaining alertness and its apparent role in addiction seems to be related to reward processing. Here, we examined whether the neurons in dorsal raphe carry signals about reward outcome and task progress during multitrial schedules. We recorded from 98 single neurons in dorsal raphe of two monkeys. The monkeys perform one, two, or three visual discrimination trials (schedule), obtaining one, two, or three drops of liquid. In the valid cue condition, the length and brightness of a visual cue indicated schedule progress and reward amount, respectively. In the random cue condition, the visual cue was randomly presented with respect to schedule length and reward amount. We found information encoded about (1) schedule onset, (2) reward expectation, (3) reward outcome, and (4) reward amount in the mean firing rates. Information theoretic analysis showed that the temporal variation of the neuronal responses contained additional information related to the progress of the schedule toward the reward rather than only discriminating schedule onset or reward/no reward. When considered in light of all that is known about the raphe in anatomy, physiology, and behavior, the rich encoding about both task progress and predicted reward outcome makes the raphe a strong candidate for providing signals throughout the brain to coordinate persistent goal-seeking behavior.

The influence of passband limitation on the waveform of extracellular action potential.

The duration of the extracellular action potential (EAP) in single neuronal recording has often been used as a clue to infer biochemical, physiological or functional substrate of the recorded neurons, e.g. neurochemical type. However, when recording a neuronal activity, the high-pass filter is routinely used to achieve higher signal-to-noise ratio. Signal processing theory predicts that passband limitation stretches the waveform of discrete brief impulse. To examine whether the duration of filtered EAP could be the reliable measure, we investigated the influence of high-pass filter both by simulation and unfiltered unit recording data from monkey dorsal raphe. Consistent with the findings in recent theoretical study, the unfiltered EAPs displayed the sharp wave without following bumps. The duration of unfiltered EAP was not correlated with that of filtered EAP. Thus the duration of original EAP cannot be estimated from filtered EAP. It is needed to reexamine the EAP duration measured for classifying the neurons whose activities were recorded under the passband limitation in the related studies.

Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex.

BACKGROUND: The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. METHODS AND FINDINGS: We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1-4 sequential color discrimination trials to obtain a reward of 1-3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount. CONCLUSIONS: Our results suggest that the rACC neurons encode information about reward proximity and amount in a manner that is dependent on utility of reward information. The manner in which the information is represented could be used in the moment-to-moment calculation of the effect of time and amount on predicted outcome value.

A 10-year angiographic follow-up of competitive flow in sequential and composite arterial grafts.

OBJECTIVE: Physiological reaction to competitive flow is considered as the primary mechanism of arterial graft occlusion. Reopening of graft lumen had been also reported, but details remain unknown. We sought to delineate the effect of management of the moderately stenotic targets on the occurrence of competitive flow and clinical results. METHODS: Clinical records and angiograms of 3263 bypass grafts in 852 patients, who underwent off-pump coronary revascularization using the internal thoracic artery (ITA) and radial artery without aortic manipulation since 2000, were examined. Dominant flow direction was graded as antegrade, competitive, and no flow (occlusion). Late angiography was performed in 157 patients with 561 bypass grafts for clinical reasons. The follow-up period was 55.5 ± 31.1 months. RESULTS: The early graft patency rate was 98.0% (3197/3263). The rate of antegrade flow was 91.5% (2986/3263), while competitive flow was detected in 6.5% (211/3263). The actuarial patency rates of bypass grafts with antegrade flow were significantly higher than those with competitive flow (87.9% at 5 years and 71.3% at 8 years, vs 25.8% at 5 years and 9.2% at 8 years, p<0.0001). In the univariate and multivariate analyses for 852 patients, territory of right coronary artery (odds ratio (OR)=2.20, p=0.0002), composite radial artery (OR=1.90, p=0.03), and the distal end of the graft (OR=2.90, p=0.0003), were identified as the significant predictors of competitive flow from the target with 51-75% stenosis. Individual grafting inversely correlated with occurrence of competitive flow (OR=0.48, p=0.04). Reopening of the graft lumen associated with progression of native stenosis was not observed in these patients. CONCLUSIONS: Competitive flow can be efficiently avoided by appropriate graft arrangement and patients' selection. Selection of the target of the graft end would be crucial to achieve antegrade bypass flow and long-term patency of entire sequential bypass grafts. For the composite graft, functional recovery of the occluded graft would be extremely rare.

Discrimination of moving video images of self by pigeons (Columba livia).

The ability to recognize self has been known to be limited to some animal species, but previous research has focused almost exclusively on the animal's reaction to a mirror. Recent studies suggest that the temporal contingency between a subject's action and the corresponding visual scene reflected in a mirror plays an important role in self-recognition. To assess the roles of visual-proprioceptive contiguity in self-recognition, we explored whether pigeons are able to discriminate videos of themselves with various temporal properties. We trained five pigeons to respond to live video images of themselves (live self-movies) and not to video filmed during previous training sessions (pre-recorded self-movies). Pigeons learned to peck trial-unique live self-movies more frequently than pre-recorded self-movies. We conducted two generalization tests after pigeons learned to discriminate between the two conditions. First, discrimination acquired during training sessions was transferred to a test session involving live self-movies and new pre-recorded self-movies. Second, the same pigeons were tested in extinction procedure using delayed live self-movies and new pre-recorded self-movies. Although pigeons responded to delayed presentations of live self-movies more frequently than to new pre-recorded self-movies, the relative response rate to delayed presentation of live self-movies gradually decreased as the temporal discrepancy between pigeons' own behavior and the corresponding video increased. These results indicate that pigeons' discrimination of self-movies with various temporal properties was based on the temporal contiguity between their behavior and its visual feedback. The methodology used in the present experiment is an important step toward improving the experimental analysis of self-recognition in non-human animals.